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ABSTRACT 



Previous work assessing the effectiveness of 



computers in education has gone no further than acknowledging a 
network of interconnected variables (comprising a system) which 
contribute to computer impact and describing its component parts. An 
impact systems model developed by Glasman and Bibiaminov (1981) has 
been adapted to facilitate measurement of change in a school's 
outcomes. This model examines cognitive and affective changes brought 
about by change in a school's inputs, including student background, 
school conditions, teacher characteristics, instructional integration 
o: computer use, student attitudes, type of computer use, and 
hardware and software characteristics. Application of the model to 
the improvement of computer impact involves examining variables frOiti 
the perspectives of manipulability and critical upper and lower 
bounds, which involves the determination of which variables are most 
important to the successful functioning of the overall system. The 
model can guide strategy for the improvement of computer impact in 
schools. The final level of consideration for decision makers relates 
to identifying effective mechanisms for manipulating critical 
variables toward •'upper bound" characteristics, where particular 
variables are powerful enough to make the system likely to be 
successful regardless of other variables. Three possible intervention 
approaches are increased funding, changes in national or regional 
policy, and changes in teacher training or retraining. (GL) 
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Manipulating Critical Variables: 
A Framework for Improving the Impact of Computers in the 
School Erivlronment 

I. What Do We Know About the EfTectiveness of Computer-Related 
Technology in the School Environment? 

We who work in the area of computer-related technology 
for educational purpose^; are frequently asked the general 
questions: "Where are we now? What do we know about computers 
and computer-related technology in the school setting? What 
works?" These are valid and reasonable questions. We as a 
community have invested considerable money and human resources 
into the investigation of computer applications in education. 
Both those who fund us and the constituencies whom we serve are 
warranted in asking these questions, especially since work in 
this area has been going on for a considerable length of 
tiii;9.-at least since the 1960s. Researchers may argue that the 
task of enhancing learning with computer technology is so complex 
that much more time is needed before the field can be expected to 
off<»r any response to general questions such as, "What works?" 
(see, for example, Dede, I98t for a review of current progress 
in "intelligent" computer-aided instruction). However, those who 
must, now, make purchasing, planning, or policy decisions, those 
who must now organize the next year's teacher training or 
inservice, cannot afford to wait until researchers work out 
convincing methodology and summations.. Decisions regarding 
implementation and reflecting expectations about the impact of 
computer use are being made daily in the field, regardless of the 
measured conclusions of the research community. In most cases, 
expenditure and enthusiasm continue despite the lack of 
convincing evidence that particular computer applications can 
transcend the complexity of the teaching/ learning process and be 
expected to "work" in particular schools or area. 

However, we cannot expect to be unaccountable, even if 
now enthusiasm for computers seem to be fueled by its own 
momentum. Eventually if we are "unable to demonstrate adequately 
any productivity increase" associated with computer use in 
education, a consequence may be that '♦the tightness and shrinking 
of educational budgets in most countries, developing and 
less-developed, may rapidly kill these innovations" (Orivel, 
1988). In order to maintain the credibility of our conviction 
that computers can offer distinct benefits in the school setting 
it is important that we make a response now, albeit an imperfect 
one, to the reasonaole questions, "What do we know? What works?" 



II. How Might We Respond to "What Do We Know?" 

Certainly we do try to respond to these questions and we 
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tend to do so in a number of predictable ways. Becker (1988) 
identifies four typical approaches: 1) broad surveys , 2) 
observations of individual situations, 3) jurisdiction^-wide 
evaluations with no controls, or 4) conclusions based on 
experimental activity but conduct over a brief time span and 
sometimes in unnatural settings . In addition to Becker • s 
categories, other typical responses may refer to areas of :urrent 
interest presumed to be able to make an impact on learning, or to 
inconclusive aspects of previous computer implementation, or to 
the complexity of the task in trying to respond to the basic 
questions. Let us look more systematically at these response 
clusters before we advocate a different framework for responding 
to "What works?" and for decision making based on this framework. 

1. Responses based on personal experience 

Thic type of response to "What works?" is most common, 
and most suspect. Although helpful and generalizable analyses 
can be made from personal experience, as for example, those based 
on well executed case study methodology (for an example, see 
Hativa, 1988b), most responses based on personal experience are 
little more that anecdotal ^eports, replete with threats to 
internal and ercernal validity because of the idiosyncrasies of 
the particular context and implementation (Clark, 1985a, 1985b). 

2. Responses based on survey data over las^e samples 

Another popular response to questions about computer 
impact in schools is to refer to data from large-scale surveys. 
Becker, in the US, (1983, 1987b) has contributed widely cited 
data using this approach. Survey data in turn describe trends 
from at least four different perspectives. 

2.1 Trends in usage, by content area or type of 
application. National studies in Canada (Collis Kass, Kieren, & 
Woods. 1988) and the U.S. (Martinez & Mead, 1988) show that 
usage focus sed on teaching about computers or about some specif er 
type of computer uscge such as word processing has become wide- 
spread in North America. However, usage focussed on augmenting 
learning of curriculum-related objectives in "mainstream" subjects 
such as mathematics or science is still "relatively rare" 
(Walker, 1988). 

As an example, less than 10 percent of a sample of 3000 Canadian 
Grade 11 students representing major urban areas in all Canadian 
provinces had ever, even once, used a computer as part of their 
science or "social studies" classes, less than 15 percent in 
tiieir English (or French) classes, and less than 20 percent in 
their mathematics classes despite universal availability of 
computers in secondary schools (Collis, Kass, Kieren, & Woods, 
1988). 



2.2 Trends in usage, by specialist groups. Survey 
data often attempt to describe usage by particular groups of 
students, most frequently gender groups, or groups defined by 
some sort of learning difficulty. The Canadian and American 
surveys described in the last paragraph also document the 
tendency o^ significantly more adolescent males than females to 
make use of available school computers. Working from a different 
perspective, Russell (1987) is one of a number of researchers who 
have investigated the extent of usage of various computer 
applications by special education practictioner s throughout the 
United States. 



2.3 Trends related to hardware. A number of surveys 
focus on the typical types and configurations of hardware in the 
school setting. These show a consistent escalation in quantity 
of computers in North America schools (see for example, Becker, 
1983, 1987b; or Gleason, 1987). Gleason's figures are typical! 
the student/computer ratio in his jurisdiction (the state of 
Wisconsin in the US) dropped from 1:155 in 1985 to 1:19 ir 1987. 
Configuration patterns, particularly computer laboratories, 
whether networked or not, are also described and analyzed in 
survey? (for axanple, see Martin & Preskill, 1987). The results 
tend to show that laboratories are well established, at least in 
secondary schools, but are not without technical, pedagogical, 
and organizational problems. 

2.4 Trends related to other characteristics of users. 
Other survey focuses include age or regional data (Martinez & 
Mead, 1988), data related to socioeconomic levels (Martinez 

& Mead), and teacher characteristics (Becker 1987b; Ellis & 
Kuerbis, 1985), among many topics. These data often 
describe inequities in access related to demographic charac- 
teristics (Collis, 1985; Lockheed, 1985). 

While survey -data are interesting and often can be uoed 
by decision makers in other juridictions , they most often have 
little direct relevance to the basic question, -What works?" 
because of their preoccupation with documenting superficial 
aspects of what is happening. Because a certain trend occurs 
does not support its essential relevance or its influence on 
improved learning. 

3. Responses based on predicted impact 

Answering "What dw-) we know?" oy predicting what could or 
should occur, based on emerging technologies or futurist 
perspectives is not uncommon. Currently at least three types of 
computer. related activities are predicted to have significant 
potential impact on education. These are telecommunications, 
date base manipulation, and CD-ROM and laser disk storage 
'Collis, 1988b). Telecommunications are claimed to have the 
potential to alter communication styles (Murray, 1985) and to 
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expand ^he "walls" of the classroom (Cohen & Mijake, 198 ; 
Keenan, 1985) both geographically and experientially . However, 
despite considerable activity in literally hundreds of 
educational teleconmrnications projects throughout the world, 
there is no consistent evidence to support their feasibility in 
the regular classroom or educational effectiveness, even in the 
research netting. If consensus is emerging from this experience 
base, it is most clearly related to the technical and practical 
problems being encountered at most <;ites. 

Sometimes responses to "What works?" are based solely on 
the observations emerging from research centers who report 
promising results with a particular computer-based application in 
their own pilot studies and laboratory projects. Logo began in 
this manner (and "success" with Logo is sti.U very likely to come 
from :uch atypical and confounded installations [Kieren, 1984)). 
The most promising new application emerging from this sort of 
well funded research activity is that of MBLs , or 
microcomputtr-bajed science laboratories for children, where 
computers ece augmented with data capturing peripherals and 
appropriate software for instantaneous da^a display and 
manipulation. So far, results from these investigations are 
promising, and suggest a real potential for impact in science 
instruction (Linn, 1987; Stein, Nachmias, & Friedler, 1988). 
However, there has been little or no diffusion of the MBL 
techniques into "regular," non-project supported classrooms, 
despite easily available software kits and extensive writing and 
discussion by the MBL community. 

4. Responses based on topics of declining interest 

Another way to respond to the question, "What works?" is 
to indicate areas of previous activity in computer applications 
in education which were once heralded as having much potential 
impact, but no longer generate much interest, either 
theoretically or practically. Perhaps the two most prominent 
examples of this type of declining interest are programming and 
authoring systems for teachers.. During the early 1980s 
programming was vigourously championed as a valuable learning 
experience for students of a wide range of ages (Luehrmaan, 1981; 
Papert, 1980). Sometimes the rationale for the advocacy was in 
the context of developing the students' computer awareness or 
computer literacy; other times the rationale was the supposed 
transfer of problem solving skills and higher-order thinking 
acquired or strengthened through the programming experience to 
other learning tasks. Despite the strong theoretical arguments 
to support this sort of transfer (most notably and perhaps most 
eloquently from the Logo community) and considerable research 
activity attempting to support this transfer, "the speculated 
link between the teaching/learning of programming languages and 
the improvement of problem solving skills has not produced much 
supporting evidence" (Palumbo & Reed, 1987). This may be to a 
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certain extent a function of design problems confounding much of 

J .hI!!r"J "*^r''' identified various 

hypotheses about these flaws, and Palumbo and Reed docume" six 
major design fUws reoccurring in typical studies) or becau ^ 
most school-based programming experiences are not of hiRh enough 
cognitive challenge to expect problem solving to eJen o^cur JlJ 
alone transfer (Mandinach i Linn. 1987). Also, computer 
competency is now seen to be more appropriately* b^T i" 
nllltVlT ri applications software rather than in programming 
(Lockheed i Mandinach. 1986) . The lack of practical suppo^^fo? 
programming probably explains the current decline in advocacy of 
programming in the school setting (other than in computer science 
classes at the senior secondary level, and even tE"re th re ! 
controversy about the appropriateness of progrl^i^: 
experiences . ) F»-o8r«mming 

Another activity which was frequently promoted as havina 
a potential impact on education was the use l{ Authoring pa^l 
by teachers so that they could 'easily- create their 5!! 

ziTtr' r""""" ^'^^^ 5his"ta " s r 

proved to be easy or even feasible, either for time or 
ii^t ? """"^ " °f technical constraints 

uJrent y " f'u'n/"'''"^'"^ ^^^^-^h Hypercar"" 

currently fueling some resurgence of interest in 
teacher -generated n^terials. there Is no rea expectation th^t 
practictioners will be generators of meaningful software 

5. Responses elaboraUng inconsistent or inconclusive support 

Another way to respond to the question, 'What works? ■ is 



Thoro • Inconclusive support for impact on learnina 

There is a dis-ppointing acknowledgement aiong many of tSe 
researchers who attempt ' o synthesize research regarding III 
mpact o computer-related applications on teaching a'nd ^a'rni^I 

^ " " expected (Becker 

1987a . Clark (1985a. 1985b). for example, reanalyzed tJ; 

^ r c'ln ':i:tTl variou? ;ell Jnl V Jh 

^^strucaon a^d Ji'T. °^ ^"^^l^i'^g computer-assisted 

ietS e??p;^f "H'^l^des that teacher effects and instructional 
Ti^^Jj^. 5 " ^"8* contributors to most of the 

significant results that are reported favouring CAI over 

surveying the current scene we do not see evidence ^f a 
significant, revolutionary use of the various communication 
va?ua°iio'i'?".^'-. <"88) discusses the "t Js of 

relative to ^I^m'* ^" "^"''^ P^^^^ed" 

llrt 7 * within-school applications of new educational 
technologies and concludes that -most are inconclusive on tSe 
effectiveness of such programs" (p. ^5). Clark. (1983). as well 
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as Ely and Plomp. note this disappointing lack of solid 
validation support pertains not only to computer-related 
technologies but to a variety of educational media. Clark for 
example, -reconsiders" the research on learning from media .' and 
states that "consistent evidence is found for the generalization 
that there are no learning benefits to be gained from employina 
any specific medium to deliver instruction" (p. 445). 

5.2 Design inconsistences in assessing the inpact of 
word processing Perhaps the area where consensus is most strong 
about the benefit of a specific computer use relates to word 
processing and the writing proceas (Daiute, 1985). Yet even here 
the research results are frustratedly mixed. as are the 
situations generating the results. Hawisher (1986) for examole 
reviews 24 studies and notes the wide range of conditions, 
outcome variables, ard outcomes that are reported. The only 
consistent result is ^.hat word processing users tend to like 
writing more with a word processor than without one. Daiute 
(1986) has done particularly helpful work in this area, she 
notes in one study for example that there was no difference 
between word-processed text and paper-and-pencil text with regard 
to the incidence of 22 of 25 common errors in writing, and that 
rather surprisingly, writers recopying a text by Sand tend to 
make more internal expansions to the material than do word 
processing users, who tend to add details to the end of a text 
rather than within it. 

™n.^ .-^"^ Complexities involved in computer impact or. 
motivation. Sutton (1987) reviews motivation more generally 
with respect to classroom computer use. He points out that 
motivation as an outcome cannot be considered a simple function 
of computer use. but is very much affected by a variety of 
factors, such as classroom context, thi way the teacher employs 
computers, and the social organization-cooperative, competitive 
or individualistic-areund which the teacher structures computer 



6. "What Do We Know?" revisited: Consensus on complexity 

rn .1 °^ '^^^^ "cent research there is one 

conclusion which is emerging again and again and which IS 
something we can respond when we are asked "What do we know?" 
H.T.l s/«earch on motivation gives an example of it. as does 
oJoir^^ ' "T". °^ word processing and Johanson's review of 
programming and its cognitive consequences. This conclusion is 
bec.a«pT'" i^P^^.^nnot be summarized in any simple statement 
n^Z . " f""'^'^"«»'ly embedded in and covarying with a large 
number of other variables. An editorial in the Phi Delta 
Kappan journal (1987) notes, "it is time to stop asking whether 

s^n.iH "^^^^ "U"der what conditions 

should we expect transfer of skills and to what other situations 
might they transfer?" 
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Collis. walker, and Grant (1987) identify unavoidable 
confounding in any computer use situation because of at least 
teacher characteristics; instructional decisions surroundina the 
computer use; school. class. and class environment 
characteristics; student-specific characteristics; and software 
and hardware characteristics. Hawkins and Sheingold (1986) note 
that technological innovations "are interpreted and shaped by the 
knowledge, experience, and setting of those teachers and students 
who encounter them" (p. 43). Pea and Sheingold express this 
complexity rather gracefully wh^n they say. "educational 
technologies serve as mirrors of minds and the cultures in vhich 
they 'live- ..They reflect the expectancies represented in 
classrooms and the knowledge «nd skills of individuals usinR 
them" (p. X). This is in the same spirit as Walker's (1986) 
observation that ;it is the people and the institutions they 
create and sustain who determine the success or failure of an 
innovation. And even when an innovation meets people's expressed 
needs, it may still rot succeed unless it fits ii with the 
patterns by which they run their lives as students and teachers" 
(p.5) . 

So. we do have an answer when people ask us. "What do we 
know? but the answer is not the one people want to hear because 
it raises more questions than it resolves. What we know most 
clearly about the impact of computers in education is that this 
impact depends on m«ny other things. We know we are dealine with 
a network of interconnected variables, where an alteration in any 
one of them can affect the entire system (Educational Technology 

f • I^'"' ^°^^^''' ' Therrien. 1987; viske. ft 

al.. 1988) This systems conception is net new in education; it 
has been developed, among other focuses, for reading research 

,r\HT. effectiveness research 

(Glasman i Bimaminov. 1981; stoel i Scheerens. 1988; Webster i 
?QAA?' • f educational technology in general (Elj i Plomp. 

1986). What is relatively undeveloped, however, is wnat to do 
with this systems approach other than acknowledge it and describe 
Its component parts. The remainder of this paper will develop an 
integrated systems model for computer impact in the school in 
ordei to hypothesize some causal aspects of the model and to 
suggest an approach to using the model for improving the impact 
of computers in the school environuent . » f» 

III. A Computer Use Impact Model 

Biniaminov (1981). in their analysis of 
input and "outputs" of schools, synthesized 33 studies that 
attempt to measure change in a school's outcomes brought about or 
!Lh u by changes in the school's inputs. In each 

study, the school was seen as a system. Their synthesis of these 
studies produced a structural causal model with five input 
clusters (p. 536): 
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a. Student background characteristics 

b. School conditions (such as seri.>!« . 

c. school-related «Lel hi::"! "!^'."P«"di^""«) 



i^"f""^"^" (such a; 



sociodemography of student population) 

d. Instructional personnel P"^"ion) 

e. Student attitudes 

and secondary (or indirect) effects a J to hypothesize main 
that teacher characteristics ind T ^""^^ hypotheses was 
outcomes most directly and sJron^w influenced 
variable clusters. tLs mode car Je ^5'"' '° °^her 
•input-output" research syntheses L * framework for 

including the impact of com^;te"s"in^he^^\o1r:e^^°^;;;°"^"^'• 

In order to use this 
associated with computer usp , ^° ^^^"'^^^ outputs 

clusters must be add'ed and exi tino c? ^« '^-p'^d; 

based on the research specific Jo^ ' ! "^^^^^^^d 
Appropriate clusters for such a^d^nr.'r education, 
and defended as follows: adaptation could be defined 

I. '"•'J^'Wual student background characteristics 

-Family socioeconomic -nd educational levels 
-Presence of a home computer 
-Student's aptitude 

-Student's gender ^ 

rel-tion'^'iet'^eer'fa^-Uy ^'lllV^Zll ''^^ P^^^^- 

availability, .nd likelihood of ^ Jji 'iT', '^^"P^ter 

males. Their work, and that of ™^ computer-for 

strongly associated with «sponseT/H 8^"^" t,e 

computers. Research done at tS! ?h . ^"Sagement with school 

(1988) at Harvard University relnfn -""'l Technology Center 

students' prior conce" ion^ of ^nd^rsL'ndi'"''"*' °' """^ 
natter or computer use affect ""^^"'^''"dings about subject 

t'^erefore its impact Hati^a (1988a? 'h"'°"" T 
the differential impact of comnut!f carefully documented 

ability levels. She notes L °? °^ different 

Children using a mathe^tic; driU l'^^'"' -^^^ity 
ardware-related errors^'^gj ^bi^u'v^hi^;'' «^ 
She also notes that -there wifl Iw, children do not make, 
from some particular tjpe of fcZ . ^jenefit 
sutdents. with different 'altitude aTst" ""J* ""^'^ 
face problems working in tha't^'prr^^utrl^de" (p^'xsT'"'"'' "'^^ 
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2. School conditloos 



-Characteristics of support for computer us»o 
-Appropriateness of inservice opportunities 
-Administrative encouragement of computer use 

Cox. Rhodes, and Hall (1988) and Collis (1988c) are among 
many who note the need teachers have for extra preparation time 
and for other aspects of in-school support in order to make 
effective (or indeed, any) use of school computer opportunities. 
Cox and her colleagues also document the importance of the 
headmaster, or principal, in nurturing computer impact in the 
school. Cuban (1985) notes the impact the school environment and 
the "culture of teaching" have on subsequent computer impact. He 
connents that "settings have plans for their inhabitants" which 
•situationally constrain choice" for both teachers and students 
with respect to computer use. Many researchers have noted the 
critical importance of appropriate inservice and modelling for 
teachers in terms of vhit they eventually do with computers ii: 
their classrooms. The "levels of concern" t >del (Hall, Loucks 
Rutherford, i Newlove, 1975; Mitchell, 1988) provides useful 
insights into a framework for planning inservice for the teacher 
b^sed on his level, both qualitative and quantitative, of 
experience with an innovation such as computer use in the 
classroom. Broyles and Tillman (1985) show tliat mismatches 
between ins-rvice orientation and teacher's level of concern can 
result in unproductive and even stress-elevating situations with 
negative consequences for subsequent implementation decisions on 
the part of the teacher, wiske and his colleagues (1988), iu a 
nationwide Ptudy sponsored by the Office of Technology Assessment 
of the US Congress, note that a school support environment that 
fosters teachers' professional growth and development in computer 
applications is a necessary (but not sufficient) conditioa for 
general staff engagement in effective computer use. 

3. Personal Teacher Characteristics 

-Teacher's intellectual level 

-Teacher's subject matter knowledge 

-TeacheT's acceptance of computer use 

-Teacher's expertise in computer applications in 
the classroom 

-Teacher's attitudes and self-confidence 

-Teacher's preferred instructional style 

There is an abundance of evidence that the teacher is a 
critical variable in the impact of -ny educational tool, 
including computers (see, for example, Begle, 1979; Brophy, 
1986). Levin, Leitner, and Meister (1986) found "profound" 
differences in the impact of a very structured computer-delivered 
drill and practice system when this system was monitored by 
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different teachers. even though the system (Suppes- CCC 
curriculum) -Ppears to be virtually te.cher-inSependent 
Researchers at the Educational Technology Center (1988) nltltL 
inevitable impact of the teacher's ?intellect«l! agendl' on 
computer impact and "vehemently contradict th. popular notion 
that computer-based lessons can be self -implementing. . .teachers 
need a clear understanding of the purposes of the (computer! 
jjat ..rials, an image of how to manage teaching in a new iay. «nd a 
detailed map of the subject matter they have to teach" Vp 20) 
with (or without) computers. Berger (1986) documents the impact 
of science teachers' misconceptions and "thinconceptions" on 
their subsequent use of computers to augment laboratory 
investigations. As ucted before, the teacher's "level of 
concern" or experience with computer use in the classroom 
critical y affects his response to inservice offerings in t"; 
'"^r M ; P"'*'"' effectiveness in using computers 

with his students. The teacher's attitude toward computers 
toward the use of computers in his lesson, and toward himself"; 
a computer user all affect the impact or even existance of 
computer experiences for his students (Cox. Rhodes, i Hall. 1988- 

deatS'^^ti o • T.tV' 'l''V "-P^^- "igh 

death rate of within-school media [computer] projects is often 

ue to teachar rejection" (p. 46?. ieaJher^'s p eferreS 
instructional style is .iso . critical variable Effecting 

^""^ ^^'^^^ -"^ his colleagues ioJ! 

that teachers are unlikely to change their characteristic 

•mos? tLcL';« ""''""^"8 '^^■"P^ter use. and indeed, 

most teachers report no change in teaching style (after starting 

"yie"(wJs^r:r:i:."j:88)"'"^^ ^° ^^-^^ 

4. Instructional Integration of computer use 

-Curriculum relevance 
-Lesson integration 
-Teacher guidance and feedback 
-Organization of student usage 

no«ft^ P«"°nnel at the Educational Technology Center at Harvard 
(1988 . among many others . have noted the critical importance 
" e-^-^tual impact, of how the teacher integ^te 
computer use into a lesson or teaching unit, m trying to awist 
eachers with this integration, they' are developing "infu^M" 
upport materials for teachers. In addition to cSrricuUr a^d 

colllllr. ? ""Bgestions to their students a. the students us5 
earners .1° ""''J '"P"" °' '''' ""P"'^" °" the 

elllTcll' tLr^M''""^ : f."^" that 

•exnlnr^^ '^"!'=';i''8 should accompany students' computer 
explorations" in order for effective impact to occur. Cox 

nack^'of^^J observe that teachers frequently have i 

lack of knowledge of how or when to join in children's 
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microcomputer activities" (p. i76) and thus children fail to 
earn, or "discover.- what they might with judicious eacher 
intervention. The social organization surrounding students- 
computer use-if they are guided to work in pair! or gro^p 

(Sutton. 1987, Webb & Lewis. 1987). Webb's work in a variety of 
studies supports the value of students working in groups"' the 

"h"J !i fS'L.?"*'*"^"^ )• Mehan. MilLr-Souviney 

and Riel (1984) note a similar benefit for writing in a soril* 
setting They feel that -it is not the comJ^Jer per^e th^ 
responsible for improved writing." but that the computer c^n be 
the catalyst for an environment that "makes a new "cia! 
organization for reading and writing possible." In their opinio^ 
it IS the social organization and not the computer alone h^^ 
has positive effects on the reading and writing process." 

In general, then, the teacher is a critical variable in 
computer impact, both throug:. his personal characteristics anS 
his instructional decisions. "One can theorize with the be t of 
intentions how teaching and school learning could be optimized 
but the finest ideas and proposals must s?ill pass thro^gj tS; 
funnel of teacher planning" (Clark. 1986). ^ 

5. Student attitudes 

-Student's interest in computers 

-Student's self-confidence about computer use 

«nd BiniflTn^" "bout Student attitude in Glasman 

and Biniaminov's study, there is also evidence in the area of 
:"ec "on ^^-'^ ""<»ent attitudes bill a dir t 

effect on the outcomes associated with computer use in the 
classroom. student attitude and self-efficacy have particular 
impact on the "effort (the students) will invest^ in computer ise 
( alomon. 1981) However, attitude seems so strongly ZJated by 
of " 'J"*'' ^'"'^h aJ gender. prioJ 

student cn™^?^ "" ^''l! '^^'"P"^"^' teacher expLtationJ of 
student competency, teacher behaviours, etc.) that it must be 

Of" h'^ri irT'' /f'^^^' exist^'ind^ e:;d:;t ; 

cLZ. self-confidence about oneself as a 

omputer user, for example, is strongly related to gender, in 

ef ect nf 8'"**" """" ^^"^l" caS mask the 

llltT V- computer experiences on subsequent participation 

(Kass. Kieren. Collis. Therrien. 1987). ^ ^ h 

6. Type of computer use 

-Drill, vutorials 
-Simulations 
-Open-ended tools 
-Programming 
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This dimension was certainly not part of Glasman and 
Biniammov^s model but is critical to ourc. There are many ways 
to categorize type of computer use; the four above reflect an 
underlying continuum of self -containedness of this use. This 
continuum could also be described as one of content specificity. 
The importance of teacher interaction occurs with all types of 
computer use (note Levin. Leitner. and Meister's 1986 study of 
variations in cost effectiveness of the same computer drill 
material uped by different teachers in different schools) but 
accelerates as the type of usage becomes more open-ended. 

In addition, the type of computer use can have different 
impacts on different types of users. especially so with 
•learner-centered- software (Russell. 1987) where the child is 
meant to assume control of various decisions within the use of 
the computer application. Student characteristics also mediate 
the effect of different types of computer use; Rowland and 
Stuessy (1987). for example, are among a number of researchers 
who have shown tutorials to be more effective than simulations 
for certain types of students (those with a serialist as opposed 
to holistic orientation, those with external rather than internal 
locus of control, and those with relatively lower memory skills). 
This sort of study, however, becomes difficult to interpret 
unless we know more about the instructional context of the use of 
the software and about the intervening teacher effect. In 
general, these same problems of situation confounding are likely 
to obscure interpretation of research comparing types of computer 
use. especially those in the "Logo versus BASIC" category, 
although some studies are available that that do a reasonable job 
in controlling confounding factors in order to isolate a 
computer-use effect. Two examples are Martin. Shirley, and 
McGinnis' (1987) study of simulation versus non-simulation 
experiences and their transfer to achievement in ecology units 
for fifth- and sixth-graders, and Stein. Nachmias. and Friedler's 
(1986) investigation of science laboratory experiences for eighth 
graders with and without computer data capturing (MBL) support 
and the impact of this type of computer use on set-up time. 
<^ff-task behaviour, quality of graphic displays of results, 
ability to draw valid conclusions from data, and student 
attitudes. 

7. Software characteristics 

-Choice of wording, contents 

-User interface characteristics 

-User control of movement through software 

There have been many studies on the impact of various 
aspects of software design on student learning, Gillingham 
(1988) reviews a subset of over twenty of them, relating to 
length of text presented at one time, user control or program 
control of text presentation, scrolling and timing of text 
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i presentation of text on the screen, and 

impact of text structure. He notes particularly the importance 
of considerate text." where the user's metacognitive monitoring 
ulifTA'' / '"^ ''^"^ adequately structured, coherent 

^hI /"? information-appropriate. Many other studies have 

Identified the impact of specific design decisions on student 
learning or motivation. Ross and Anand (1987). for example, note 
that inserting students' names and student-supplied names of 
people and places into sixth-graders' computer -delivered 
mathematics word problems was advantageous for both achievement 
and attitude compared to the use of the same software with 
pre-set names in the problems. Land (1988) investigated the 
impact of scrolling of text in tutorial software and found it 
more effective with "low clarity presentations than with well 
explained, or "high clarity" presentations; this study and others 
suggest that scrolling can help compensate for "inconsiderate 
text" but may even can interfere with the processing of 
considerate text." especially for able students. Hativa (1988b) 
provides very useful comments on characteristics of drill 
software that appear to "hinder achievement" compared to 
penc 1-and-paper practice of the same arithmetic drill material. 

Clearly, some of the software issues identified by these 
researchers are mainly pertinent to convergent, fixed-content 
software rather than to open-ended, tool-type software. However, 
software characteristics remain important regardless of the level 
of open-endedness (Wiske. et al.. 1988); Ely and Plomp (1986) 
comment that, "rarely is there any typ'. of educational technology 
project that has sufficient amounts of quality software, probably 
the most importnat element of the total delivery system" (p. 
243). Although some would argue the final clause of this 
statement, there is consensus that software characteristics 
particularly user interface aspects, have a critical impact on 
the effect of computer use in the educational setting. 

8. Hardware characteristics 

-Physical conf durations 

Interestingly, there is a virtual lack of research 
inquiry into the effect of various hardware cha.-acteristics on 
student learning despite the prominence that decisions about 
hardware purchase have in the agendas of decision makers in 
school settings. However, there has been some examination of the 
effects of hardware configuration and physical organization in 
the school--most notably, laboratory versus classroom-distributed 
-on student access and teacher/student attitudes about computer 
use (see Collis. 1988a. Chapter 10 for a summary). Martin and 
Preskill (1987) observe that many teachers using networked labs 
felt the labs provide "a valuable addition to teaching" but that 
"careful planning for implementation is critical, as is the 
principal's support, and a medium- to high match (of lab 
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activity] with educational objectives." Cheever and his 
colleagues (1986) note that a lab, "instead of integrating 
computers into the normal life of the school, keeps them separate 
from it" and "often becomes the province of a small group of 
•experts' .so that others feel excluded." The impact of this 
sense of discomfort on subsequent usage can be considerable. 

9. Combining the components into a hypothesized model for the impact of 
computers in the school context 

Based on the research, and given the eight clusters of 
variables described in the previous sections, the model 
diagramned in Figure 1 is hypothesized to represent the system 
surrounding the impact of computer use in the school context. 
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Figure 1. A model for the impact of computer use in the school 
context . 
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«««na suggests some major lines of impact 

Zsl llttllV' V," T"'*"' '° ^"^^^ interactivity 

exists between all the clusters in the model. Some of the 

components of students' .nd teachers' characteristics are stable 
atu.ibutes; others, such as teachers' attitudes about computer 
use are clearly affected by the status of the rest of the system 
Hnp« nfT! " '^'^ influence it. Thus the hypothesized 

i .Lnf - "° """t to be 

low^i!? K °^ influence network in the system. 

tZTcl Jll °" research, these lines have potentiallj more 
impact on the overall state of the system than do lines which are 
not shown in the figure. w..*^.. are 

m«H«i T"! "! "^^"^ hypotheses within this 

Tirlr'r^ U Software characteristics in themselves do not 

directly affect computer impact on students, because le impact 
vfriiJl!! so strongly a function of o^her 

Mtn. '"'^ " '^yP* °f computer use. the 

effectiveness of the instructional environment in which the 
software is used, and the personal characteristics of the teacher 
JUJlri^ !"'%v,'^? interacting with the software. Another 

radical hypothesis is that teachers' instructional decisions are 
perhaps the major influence on eventual impact, both through 
their direct effect and also through their strong effects or 
moderating influences on other variables in the system, such as 
student attitudes and software characteristics. However, because 
the model represents a dynamic systc^n. the equilibrium within it 
may well be situation specific, and therefore, in certain 
settings different variable clusters may dominate the system more 
than they do in others. 



rv. ApplicaUon of the Model to the ImprovemcDt of Computer Impact 

Now that we have posited a model, what can we do with it? 
For one thing, we can attempt to test it. in order to "alidate 
Its hypothesized paths of influences. However, this is a 
long-term research enterprise, and while critical, it may not 
appear to address the immediate ne.ds of practictioners and 
decision makers, the same people who are asking us. "What works? • 
Fortumtely there appears to be another way to utilize the model 
and tl;<s way has both practical and theoretical benefits. 
This approach involves examining the clusters and variables in 
the model through the perspectives of two sets of criteria: 
manipulability and critical upper/ lower bounds. 

1. Manipulability 

1.1 Identification of manipulable variables. Clearly, 
some variables are more amenable to manipulability than others. 
For example, the variables within the student characteristics 
cluster are unlikely to be changed by practical intervention 
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underutilized, or not utilized at all. by the majority of 
teachers, and disproportionally overutilized by a small subset of 
staff, typically the senior secondary level computer science 
teachers (Becker, 1983, 1987b; Kass. Kieren, Collis, & Therrien, 
1987; Martinez & Mead, 1988). 

2. Critical upper and lower bounds 

2.1 Defining critical bounds. The model suggests 
another approach to improving the impact of school computers. 
This approach involves the idea of critical upper and lover 
bounds for variables in the system. Critical lower bounds are 
defined as boundary conditions for particular variables below 
which the system as a whole is highly unlikely to be effective 
regardless of the value of other variables. Critical upper 
bounds in contrast are characteristics of particular varial3les 
that are powerful enough to make the system likely to be 
successful in its eventual impact regardless of other variables. 
It is, in fact, the latter \rtiich people implicitly hope exists 
when they ask, *What works? "... some computer application robust 
enough to emerge as valuable despite local situational variables. 

2.2 Critical upper bounds for systems of variables. 
The interconnectivity of the model suggests that the appealing 
simplicity of this type of conclusion about a single critical 
upper bound is probably not realistic to expect. However > 
perhaps we can identify some combinations of certain critical 
values of teacher and student characteristics, type of computer 
use, school support conditions, and instructional strategies 
which can emerge, as a unit, to have a positive impact on student 
learning. Specifying the critical values for variable clusters 
considered as a unit within the overall system, and identifying 
which values are most amenable to manipulation within this unit 
may give us a systematic and realistic way to effect change in 
eventual impact, at least in certain situations. 

An examination of the status of critical upper bounds in 
different cultural settings may also give us a more systematic 
approach for comparative research which in turn can help us 
eventually identify systemic conditions robust enough to 
influence positive impact of certain computer applications in 
different cultural contexts ^ This would truly be a powerful 
response to "What works?", if such a generalization is possible. 

2 . 3 Critical lower bounds and their effect on the 
overall system. The aspect of critical lower bounds also merits 
serious examination, especially if these lower bounds are on 
variables not amenable to manipulation but highly influential in 
the overall computer impact system. Teacher intellectual ability 
of general instructional effectiveness may be such variables; for 
example, is it possible that computer/ software characteristics 
can emerge as powerful enough to meaningfully improve learning 
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despite an unmotivated and ineffectMal teacher? Or will such a 
teacher inevitably dilute or dissolve potential computer impact 
regardless of the values of other variables such as software and 
hardware characteristics? As lon(, as teachers can choose to 
utilize computers or not. the impact of an unimaginative or 
negatively inclined teacher is a critical lower bound to the 
system, at the very least through the simple mechanism of the 
teacher deciding never to allow student-computer interaction to 
occur. However, even this is not as pessimistic as it seems; 
aggressive school policy can be developed that organizes 
systematic computer integration for all students through 
•team-teaching" arrangements with competent subject 
matter /computer specialists. Such arrangements can help override 
some negative teacher effects, at least with respect to ensuring 
all students some meaningful computer access. 

3. Applying the model for intervention decisions 

3.1 Application in the context of three general 
intervention approaches. The last example illustrates how the 
model, together with the ideas of manipulability and critical 
upper and lower bounds, can guide strategy for the improvement of 
computer impact in schools. A next level of consideration for 
decision makers involved in computer implementation in schools 
can relate to identifying effective mechanisms for manipulating 
critical variables or variable clusters in the system toward 
'upper bound" characteristics. 

Three general intervention approaches are most common: 
increased funding, changes in national or regional policy, and 
changes in tencher trai.iing or retraining. These three 
strategies can be recommended in combination as well as 
separately. The model may be able to provide a productive 
framework for consideration of the viability of these approaches 
in terms of eventual systematic changes toward a "critical upper 
bound" state. For example, the call for more funding is a 
regular reaction to frustrations about limited effectiveness of 
computer impact in school. However, it is valuable for us to 
seriously question the contribution of more funding to certain of 
the key variables in the system. Which variables are most likely 
to be positively manipulated by additional funding? Are these 
variables the most critical influences within the system? 
Increased expenditure on software development, for example, may 
have little systemic payoff if effective improvement in teachers' 
deployment of embedding instructional strategies does not occur. 
Or as another example, increased expenditure on teacher training 
may have limited impact on the overall system if the training is 
not appropriate to the experience, personality, subject matter 
insight, and preferred teaching style of the recipient of the 
training. National policy that provides funding for certain 
hardware allotments to schools may vary in effectiveness 
depending on what decisions are made about teacher support and 
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equipment may heT',„o« "/f"*! «*»Ple. better use of existing 
.5di?Tonal eju nt""\ expenditure oS 

expedite teach^rc- i familiar equipment can 

personal e ' onfiden" "'^M^ °' /-^-"^onal strategies and 
retard these sor^s"? ! ? "learning new equipment can 

back to a hardware fi^iilf. ^ '^'""' ^"''"'^ ^"'^her 
focus. '^"dware.fainUi.rity focus rath-r than an instructional 

sorts of'^ ^ benefits of applying the model. These 

r i ctivit . r ^"^"^ ''^^^'^ ^^^^ 

improvement' in the imn^ct f" ' ^^^^-or^ for realistic 

the com? exity of ?hi .1 f ^" representation of 

intervent " ' l1 i'Jdee cr a^af ^""^ P°'"^^ 
nerhans enpra<,oi i • ""^'^■l "PP" bound characteristics. 

This is our challenge as EURIT participants-can we in 
^uchT^:! fo^n^^J" - - a^ddrlss-ueHio;: 

-Where might increased expenditure be most effective in 
terns of improving computer impact in our schools? To 
What extent will responses to this question vary from 
country to country? From school to school? 

-Where in the model are the most important targets for 
aggressive national policy support? Will these 
targets vary from country to country? What can we 
lea.n from each other's experiences with respect to 
the effect of policy decisions on eventual impact of 
some component of computer use in schools? 



'""^ combination of variables relating 
iJlictlT i'f''" characteristics, type of computer 
application, and instructional strategy which 

win '° k!'"^? ^" ' positive impact on learning? 

Will this combination be generalizable to a variety of 
of cultural and national settings? 

Even if we can not achieve the isolation of criticKl 
bound combinations th.t the l..t ,„e«ion rep^Jent. or"e.ch • 
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^urrr! !k u to funding and policy interventions 

such as those in the first two questions, the model seems likely 
to make at least two contributions. First, it focusses attention 
on the complexity and interactivity of the system surrounding the 
impact of computer use on a particular learner, thus precluding 
any simple answers or prescriptions. Second, and perhaps most 
tar-reachlng, it can serve as a catalyst tor a more general 
re-examination of the nature of teaching and learning. This kind 
of analysis is likely to be beneficial for the discipline of 
education in general, as well as for the learners whom we serve. 
Moonen (1985) captures this potential in his paper on the 
computer as an "educational psychiatrist': 



The most explicit effect ol using computers in 
education for the immediate future will be that 
this approach forces everybody to think again 
very carefully about what education is all about 
and how it can be accomplished. (P. 162) 

To the extent that we contribute to this broad 
examination of educational issues, we will make a contribution to 
our field, even if the complexities of the network surrounding 
the impact of computer use in school continue to elude our 
control. 
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